Dialog Management for Rapid-Prototyping of Speech-Based Training Agents

نویسندگان

  • Victor C. Hung
  • Avelino J. Gonzalez
  • Ronald F. DeMara
  • Victor Hung
  • Avelino Gonzalez
  • Ronald DeMara
چکیده

Speech-based training agents can be described as virtual humans posing as interactive training characters with the capability to communicate in a spoken conversational manner. While creating this technology, developers face two stumbling blocks: 1) modeling the agent and its training knowledge is a time-consuming and tedious task, and 2) modern speech recognition software suffers from high Word-Error Rates caused by noisy environmental conditions. This paper presents a dialog management architecture that addresses these problems using the Context-Based Reasoning paradigm. The system minimizes the time necessary to build the training knowledge in the instructional agent, as well as tolerates the relatively high Word-Error Rates related to automatic speech recognition. Ultimately, these advantages lead to quick development of speech-based training agents. The dialog manager was directly implemented into the LifeLike Avatar, an embodied conversational agent funded by the National Science Foundation. A set of quantitative results is presented to reflect the effectiveness of the system.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Automatic Allocation of Training Data for Speech Understanding Based on Multiple Model Combinations

The optimal way to build speech understanding modules depends on the amount of training data available. When only a small amount of training data is available, effective allocation of the data is crucial to preventing overfitting of statistical methods. We have developed a method for allocating a limited amount of training data in accordance with the amount available. Our method exploits rule-b...

متن کامل

WFSTDM Builder – Network-based Spoken Dialogue System Builder for Easy Prototyping

This paper introduces a network-based spoken dialog system development tool kit: WFSTDM Builder developed by NICT. WFSTDM Builder provides functions to share and edit SLU and scenario so that developers can create a wfst-based spoken dialogue system instantly with this tool. One can test the scenario by accessing to the servers connected such as ASR, TTS and WFSTDM server via not only the tool’...

متن کامل

Making Speech Look Like Text in the Regulus Development Environment

We present an overview of the development environment for Regulus, an Open Source platform for construction of grammar-based speech-enabled systems, focussing on recent work whose goal has been to introduce uniformity between text and speech views of Regulus-based applications. We argue the advantages of being able to switch quickly between text and speech modalities in interactive and offline ...

متن کامل

Multimodal Dialog Management

Unreliable speech recognition, especially in noisy environments and the need for more natural interaction between man and machine have motivated the development of multimodal systems using speech, pointing, gaze, and facial expressions. In this paper we present a new approach to fuse multimodal information streams using agents. A general framework based on this approach that allows for rapid ap...

متن کامل

Automatic Allocation of Training Data for Rapid Prototyping of Speech Understanding based on Multiple Model Combination

The optimal choice of speech understanding method depends on the amount of training data available in rapid prototyping. A statistical method is ultimately chosen, but it is not clear at which point in the increase in training data a statistical method become effective. Our framework combines multiple automatic speech recognition (ASR) and language understanding (LU) modules to provide a set of...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2010